Class-Similarity Based Label Smoothing for Confidence Calibration
نویسندگان
چکیده
Generating confidence calibrated outputs is of utmost importance for the applications deep neural networks in safety-critical decision-making systems. The output a network probability distribution where scores are estimated confidences input belonging to corresponding classes, and hence they represent complete estimate likelihood relative all classes. In this paper, we propose novel form label smoothing improve calibration. Since different classes intrinsic similarities, more similar should result closer values final output. This motivates development new smooth based on similarities with reference class. We adopt similarity measurements, including those that capture feature-based or semantic similarity. demonstrate through extensive experiments, various datasets architectures, our approach consistently outperforms state-of-the-art calibration techniques uniform smoothing.
منابع مشابه
Memory-Based Learning: Using Similarity for Smoothing
This paper analyses the relation between the use of similarity in Memory-Based Learning and the notion of backed-off smoothing in statistical language modeling. We show that the two approaches are closely related, and we argue that feature weighting methods in the Memory-Based paradigm can offer the advantage of automatically specifying a suitable domainspecific hierarchy between most specific ...
متن کاملMemory-Based Learning: Using Similarity for Smoothing
This paper analyses the relation between the use of similarity in Memory-Based Learning and the notion of backed-off smoothing in statistical language modeling. We show that the two approaches are closely related, and we argue that feature weighting methods in the Memory-Based paradigm can offer the advantage of automatically specifying a suitable domainspecific hierarchy between most specific ...
متن کاملManifold-based Similarity Adaptation for Label Propagation
Label propagation is one of the state-of-the-art methods for semi-supervised learning, which estimates labels by propagating label information through a graph. Label propagation assumes that data points (nodes) connected in a graph should have similar labels. Consequently, the label estimation heavily depends on edge weights in a graph which represent similarity of each node pair. We propose a ...
متن کاملSimilarity-based Multi-label Learning
Multi-label classification is an important learning problemwith many applications. In this work, we propose a principled similarity-based approach for multi-label learning called SML. We also introduce a similarity-based approach for predicting the label set size. The experimental results demonstrate the effectiveness of SML for multi-label classification where it is shown to compare favorably ...
متن کاملClass label versus sample label-based CCA
When correlating the samples with the corresponding class labels, canonical correlation analysis (CCA) can be used for supervised feature extraction and subsequent classification. Intuitively, different encoding modes for class label can result in different classification performances. However, actually, when the samples in each class share a common class label as in usual cases, a unified form...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Lecture Notes in Computer Science
سال: 2021
ISSN: ['1611-3349', '0302-9743']
DOI: https://doi.org/10.1007/978-3-030-86380-7_16